Expand test coverage for native AOT on android #121217

sbomer · 2025-10-30T20:47:29Z

Enables building native AOT smoke tests for android with one APK per test project
Adds marker files to set expected exit code when running through helix
Adds a runtime-androidemulator job for native AOT smoke tests
Expands libraries test coverage to include non-smoke tests
Sets up appcontext base directory in test host
Calls managed main through a pinvoke when running Exe project in the runtime tests

Fixes #120715

- Expand native AOT smoke tests to all libraries tests - Add job for runtime smoke tests using native AOT on emulator

Move NDK compiler logic to a shared props file and import it in test and build projects to unify Android NativeAOT and Mono builds.

- Set ASSETS_DIR for crypto tests (using same pattern as existing crypto test) - Set AppContext.BaseDirectory We should probably change crypto tests to use just AppContext.BaseDirectory.

- Use ReferenceXUnitWrapperGenerator != false to define SINGLE_FILE_TEST_RUNNER (android & singlefile targets) instead of IsFunctionalTest - Condition SingleFileTestRunner compile and TrimmerRootAssembly (TestUtilities) on wrapper/generator and SkipTestUtilitiesReference - Add Android NativeAOT publish/trim settings and set NativeLib/CustomNativeMain for android nativeaot - Make DisableImplicitFrameworkReferences respect preexisting value and add explicit DisableImplicitFrameworkReferences=false in nativeaot tests dir - Import testing\tests.targets when TargetsAndroid is true - Update many NativeAOT smoke tests Main signatures to public static int Main(string[] args) to match runner invocation

- Ensure they have Main entry point - Tighten MSBuild conditions: - Only set NativeLib/CustomNativeMain for Android when OutputType == Exe - Only import testing/tests.targets for Android when using MicrosoftNETSdk and building executables - Make TestNativeAOT/UseNativeAOTRuntime defaults apply when TestBuildMode == nativeaot and only include monodroid-nativeaot.cs for executable/XUnit-wrapper cases

This reverts commit 4ed06ec.

- Avoid importing logic for SharedLibrary - Fix library filename - Set HasMergedInTests to ensure projects build

This reverts commit 37b7b4e.

This import is now covered by the IsMergedTestRunnerAssembly property. Fixes a warning about a double import. Fixes issue where mono runtime tests are getting incorrect assembly name due to this undesired import.

sbomer · 2025-11-10T21:05:22Z

/azp run runtime-androidemulator

sbomer · 2025-11-10T21:05:27Z

/azp run runtime-android

azure-pipelines · 2025-11-10T21:05:32Z

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines · 2025-11-10T21:05:37Z

Azure Pipelines successfully started running 1 pipeline(s).

MichalStrehovsky

Looks good but I don't know anything about xharness or android testing. Would be nice if someone else who knows about those could look at it from that angle.

MichalStrehovsky · 2025-11-13T21:47:55Z

src/libraries/Microsoft.Extensions.Hosting/tests/UnitTests/HostApplicationBuilderTests.cs

                return path + Path.DirectorySeparatorChar;
            }
- 
+


Did you mean to leave this in?

src/tests/nativeaot/SmokeTests/MultiModule/MultiModule.csproj

MichalStrehovsky · 2025-11-13T21:54:39Z

/azp run runtime-nativeaot-outerloop

azure-pipelines · 2025-11-13T21:54:55Z

Azure Pipelines successfully started running 1 pipeline(s).

- Fix left-over whitespace change - Remove unnecessary ClrTestTargetUnsupported condition

sbomer · 2025-11-13T22:30:49Z

/azp run runtime-android

sbomer · 2025-11-13T22:30:55Z

/azp run runtime-androidemulator

azure-pipelines · 2025-11-13T22:30:56Z

No pipelines are associated with this pull request.

azure-pipelines · 2025-11-13T22:31:01Z

No pipelines are associated with this pull request.

azure-pipelines · 2025-11-13T22:31:23Z

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines · 2025-11-13T22:31:29Z

Azure Pipelines successfully started running 1 pipeline(s).

sbomer · 2025-11-13T22:31:41Z

/azp run runtime-nativeaot-outerloop

azure-pipelines · 2025-11-13T22:31:51Z

Azure Pipelines successfully started running 1 pipeline(s).

sbomer · 2025-11-13T22:32:35Z

@simonrozsival @jtschuster you've both touched the android test infrastructure, I'd appreciate another review from one of you if you get a chance!

src/mono/msbuild/android/build/AndroidBuild.props

jtschuster

Looks good to me!

sbomer · 2025-11-17T02:08:53Z

/azp run runtime-androidemulator

sbomer · 2025-11-17T02:08:58Z

/azp run runtime-android

azure-pipelines · 2025-11-17T02:09:02Z

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines · 2025-11-17T02:09:09Z

Azure Pipelines successfully started running 1 pipeline(s).

sbomer added 30 commits October 13, 2025 17:21

Add more native AOT on android ci test coverage

3bf76d6

- Expand native AOT smoke tests to all libraries tests - Add job for runtime smoke tests using native AOT on emulator

Remove --cross argument, fix and disable some libs tests

432572c

Remove --cross argument, fix and disable some libs tests

214d1f9

Set runtimeFlavor to coreclr

a9eeff0

Parameterize runtimeFlavor in Android job definitions

5253ab2

Remove runtimeFlavor: coreclr from Android emulator pipeline

9d8577b

Fix typo in runtimeFlavor parameter name

fef0415

Add 'nativeaot' arg to testBuildArgs for Android emulator

c509f51

Increase timeout to 180

4cbbff5

Refactor Android NDK compiler selection for test builds

c1292f1

Move NDK compiler logic to a shared props file and import it in test and build projects to unify Android NativeAOT and Mono builds.

Increase timeout to 240

dfbf8ea

Pass RuntimeFlavor to AndroidAppBuilderTask

b8abeba

Check TestBuildMode instead

cc1d5c3

Fix a few test failures

2b7f252

- Set ASSETS_DIR for crypto tests (using same pattern as existing crypto test) - Set AppContext.BaseDirectory We should probably change crypto tests to use just AppContext.BaseDirectory.

Set Environment.CurrentDirectory to app files directory

1ee5f13

Exclude tests failing due to missing calli marshalling support

cce4d9a

Exclude tests failing due to missing crypto shim export

e6338fb

Disable directory apk build for smoke tests

eec6deb

Try using merged test runners

4ed06ec

Revert "Try using merged test runners"

cbcca7d

This reverts commit 4ed06ec.

Add Merged marker for smoke tests

37b7b4e

Try merged wrappers again

9e89dda

- Avoid importing logic for SharedLibrary - Fix library filename - Set HasMergedInTests to ensure projects build

Revert "Add Merged marker for smoke tests"

3a266b8

This reverts commit 37b7b4e.

Fix some issues with non-standalone build

a0c0cd6

Remove buildAllTestsAsStandalone

55b18f5

Set expected exit code

8e60575

Remove redundant import

9f6e630

This import is now covered by the IsMergedTestRunnerAssembly property. Fixes a warning about a double import. Fixes issue where mono runtime tests are getting incorrect assembly name due to this undesired import.

Fix mono test build

d4d4ad3

build-analysis bot mentioned this pull request Nov 11, 2025

Known Test Repository Issue Sometimes Misses Test Failures dotnet/dnceng#6411

Open

3 tasks

sbomer requested a review from MichalStrehovsky November 13, 2025 19:54

MichalStrehovsky approved these changes Nov 13, 2025

View reviewed changes

PR feedback, increase timeout

d6fef18

- Fix left-over whitespace change - Remove unnecessary ClrTestTargetUnsupported condition

sbomer requested review from jtschuster and simonrozsival November 13, 2025 22:29

jtschuster reviewed Nov 13, 2025

View reviewed changes

src/mono/msbuild/android/build/AndroidBuild.props Outdated Show resolved Hide resolved

jtschuster approved these changes Nov 13, 2025

View reviewed changes

build-analysis bot mentioned this pull request Nov 14, 2025

Sometimes the helix SDK uses GetWorkItemsAsync when workitems aren't done processing. dotnet/dnceng#6011

Open

3 tasks

simonrozsival approved these changes Nov 14, 2025

View reviewed changes

Consolidate NdkToolchainPrebuiltOS, disable tests

b127e0e

Expand test coverage for native AOT on android #121217

Are you sure you want to change the base?

Expand test coverage for native AOT on android #121217

Conversation

sbomer commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sbomer commented Nov 10, 2025

Uh oh!

sbomer commented Nov 10, 2025

Uh oh!

azure-pipelines bot commented Nov 10, 2025

Uh oh!

azure-pipelines bot commented Nov 10, 2025

Uh oh!

MichalStrehovsky left a comment

Choose a reason for hiding this comment

Uh oh!

MichalStrehovsky Nov 13, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

MichalStrehovsky commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

sbomer commented Nov 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sbomer commented Nov 13, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

sbomer commented Nov 13, 2025

Uh oh!

azure-pipelines bot commented Nov 13, 2025

Uh oh!

sbomer commented Nov 13, 2025

Uh oh!

Uh oh!

jtschuster left a comment

Choose a reason for hiding this comment

Uh oh!

sbomer commented Nov 17, 2025

Uh oh!

sbomer commented Nov 17, 2025

Uh oh!

azure-pipelines bot commented Nov 17, 2025

Uh oh!

azure-pipelines bot commented Nov 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

sbomer commented Oct 30, 2025 •

edited

Loading

sbomer commented Nov 13, 2025 •

edited

Loading

sbomer commented Nov 13, 2025 •

edited

Loading